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^ . Abstract 

We introduce the zeta number, natural halting probability and natural complexity 

C/3 , of a Turing machine and we relate them to Chaitin's Omega number, halting prob- 

, ^ , ' ability, and program-size complexity. A classification of Turing machines according 

to their zeta numbers is proposed: divergent, convergent and tuatara. We prove 

04 ' the existence of universal convergent and tuatara machines. Various results on (al- 

^ , gorithmic) randomness and partial randomness are proved. For example, we show 

' that the zeta number of a universal tuatara machine is c.e. and random. A new 
CO . 

, type of partial randomness, asymptotic randomness, is introduced. Finally we show 

' that in contrast to classical (algorithmic) randomness — which cannot be naturally 

I characterised in terms of plain complexity — asymptotic randomness admits such a 
characterisation. 

o 

P. • 1 Introduction 



X 



We introduce the zeta number, natural halting probability and natural complexity of a 
^ ■ Turing machine and we relate them to Chaitin's Omega number, halting probability, 

and program-size complexity. A classification of Turing machines according to their zeta 
numbers is proposed: divergent (zeta number is infinite), convergent (zeta number is 
finite), and tuatara (zeta number is less than or equal to one). Every self-delimiting 
Turing machine is tuatara, but the converse is not true. Also, there exist universal 
convergent and tuatara machines; there is a tuatara machine universal for the class of 
convergent machines. 

The zeta number of a universal self-delimiting Turing machines is c.e. and (algorith- 
mically) random, and for each tuatara machine there effectively exists a self-delimiting 
Turing machine whose Chaitin halting probability equals its zeta number; if the tuatara 
machine is universal, then the self-delimiting Turing machine can also be taken to be 
universal. 

For each self-delimiting Turing machine there is a tuatara machine whose zeta number 
is exactly the Chaitin halting probability of the self-delimiting Turing machine; it is an 



open problem whether the tuatara machine can be chosen to be a universal self-delimiting 
Turing machine in the case when the original machine is universal. 

Let s > 1 be a computable real, T a universal Turing machine, and Kt be the plain 
complexity induced by T. In analogy with the notion of Chaitin partially random reals 
we introduce the notion of a "1/ s--/^-random real" (a real ex — Q.x\ ■ • • Xyyi • • • such that 
the prefixes of its binary expansion are 1/s — X-random, i.e. Kt{xi ■ ■ ■ Xm) > m/s — c, 
for some c > and all m > 1) as well as the notion of an "asymptotically random real" 
(l/t-ET-random real, for every computable t > s > 1). 

The result due to Chaitin and Martin-Lof showing that there is no infinite sequence 
whose prefixes have all maximal K complexity (also true for H complexity) is no longer 
true for asymptotically random reals (Theorem 1401 and Theorem I53() . However, 1/s — 
i^-randomness is different from Chaitin randomness (Proposition I38|) . Every c.e. 
random number is asymptotically random (Theorem I48|l . but the converse implication 
fails to be true: there exists a self-delimiting Turing machine whose zeta number is 
asymptotically random, but not random (Theorem I5()|). 

Various examples illustrate the above notions and results. Some open problems con- 
clude the paper. 

2 Omega and zeta numbers 

It is well-known that the Halting Problem, i.e. the problem of deciding whether an 
arbitrary Turing machine halts or not on a given input, is Turing uncomputable. The 
probabilistic version of the Halting Problem, first studied by Chaitin [7| |S] , deals with 
the halting probability, i.e. the probability that an arbitrary Turing machine halts on a 
randomly chosen input. Chaitin's halting probability was studied intensively by various 
authors (see 22. 20,.i21lllj). Chaitin's halting probability is not defined for every Turing 
machine, hence Chaitin and his followers have worked with a sub-class of Turing machines 
which has equal enumeration power as the class of all Turing machines, namely the self- 
delimiting Turing machines. 

A self- delimiting Turing machine C is a Turing machine which processes binary 
strings into binary strings and has a prefix-free domain; that is, if C{x) halts (is de- 
fined) and y is either a proper prefix or a proper extension of x, then C{y) is not defined. 
The domain of C, dom(C), is the set of strings on which C halts (is defined). 

Definition 1 (Chaitin's Omega Number). The halting probability (Omega Number) 
of a self-delimiting Turing machine C is 

^dom(C) = X] 2"IpL 
p e dom(C) 

The number r2dom(c)' usually written f^c", is a halting probability. Indeed, pick, at 
random using the Lebesgue measure on [0, 1], a real a in the unit interval and note that 
the probability that some initial prefix of the binary expansion of a lies in the prefix-free 
set dom(C) is exactly VLc- 

More formally, let S = {0, 1} and let S*, S'^ be the set of binary strings and infinite 
binary sequences, respectively. For A C = {tux | w G ^, x G S"^}, the cylinder 

induced by A, is the set of sequences having a prefix in A. The sets ATi'^ are the open 
sets in the natural topology on S'^. Let denote the usual product measure on S'^ given 
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by the uniform distribution ^{{0}T,'^) = = 2^^. For a measurable set C of 

infinite sequences, /i(C) is the probabihty that x G C when x is chosen by a random 
experiment in which an 'independent toss of a fair coin' is used to decide whether = 1- 
If A is prefix-free, then fi{AT,^) = XluieA^"'"'' ~ ^-4' ^^^^ IM is the length of the string 
w. We assume everywhere that min0 = oo. For more details see pi 

Let a = O.X1X2 ■ ■ ■ Xn • • • G [0,1] with Xi £ {0,1}, and let X1X2 - - ■ Xn ■ ■ ■ be the 
unending binary expansion of a. We put a[n] = xiX2 ■ ■ ■ Xn- If y = yiy2---yn, then 

Definition 2. The Turing machine U is universal for a class of Turing machines if for 
every Turing machine C € 5J there exists a fixed constant c > (depending upon U and 
C) such that for every x € dom(C) there is a string px G dom(C/) with \px\ < \x\+c and 
U{px) = C{x). In case C/ G SfJ, we simply say that the machine U € ^ is universal. 

A classical result states: 
Theorem 3. 7 We can effectively construct a universal self- delimiting Turing machine. 

Definition 4. a) The plain complexity of the string x G S* with respect to a Turing 
machine M is Km{x) = m.\n{\w\ \ w G S*, M{w) = x}. 

b) The program-size complexity of the string x G S* with respect to a self-delimiting 
Turing machine C is Hc{x) = m.m.{\w\ \ w G S*, C{w) = x}. 

Definition 5. a) |29j A real a G (0, 1) is computahly enumerable (c.e.) if it is the limit 
of an increasing computable sequences of rationals. 

b) f |3Ul 1^) Let e be a computable real and U a universal self-delimiting Turing 
machine. A real a G (0, 1) is Chaitin e-random if there is a constant c such that for each 
n > 1, Hu(a[n]) > e ■ n — c. We say that a is Chaitin partially random if it is Chaitin 
s— random for some computable real 1 > e > 0. 

c) 13 A real a G (0, 1) is (algorithmically) random if it is 1-random, i.e. there exists 
c > such that for all m > 1, Hu{a[m]) > m — c. 

The following theorem gives a full characterisation of c.e. and random reals: 

Theorem 6. fpi 1141 0]1 A real a G (0,1) is c.e. and random iff there exists a universal 
self- delimiting Turing machine U such that a = flu- 

The definition of Chaitin's halting probability allows an apparent "ambiguity" as 
strings with the same length in the domain of the self-delimiting Turing machine con- 
tribute equally towards the halting probability* This motivates us to introduce a slightly 
different "halting probability" in which different strings in the domain of the machine 
have different contributions to the "halting probability" . 

Let N = {1, 2, . . .} and let bin : N ^ S* be the bijection which associates to every 
n > 1 its binary expansion without the leading 1, 

*The "ambiguity" is apparent because from the first n bits of flu we effectively calculate the strings 
in dom(C/) that determine these digits. 
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If ^ C S*, then we define T[A] = {n G N | bin(n) € A}. In other terms, the binary 
expansion of n is n2 = Ibin(n). 

Definition 7 (Zeta number of a Turing machine). The zeta number of the Turing 
machine M , denoted C,m, is 

^-^ n 

neT[dom(M)] 

The number C,m wih be shown to be random in the same sense as in case M is 
'universal' (for example, if M is a universal self-delimiting Turing machine, Theoremll3|). 

One might ask whether there is also some sense in which C,m is a halting probability. 
For many Turing machines, Cm is not a probability; for example, a total Turing machine 
M, i.e. dom(M) = S*, has Cm = oo. 

However, for a universal self-delimiting Turing machine M, C,m is a halting probability. 
Here is an informal argument. In an alphabet with k symbols, the probability that the 
k-axy expansion of n appears is proportional to A;~l-^°Sfe "J-i^ while the measure assigned 
to n in the definition of Cm is /i;~'°^'=". By letting k approach 1 from above, we can 
eliminate the roughness in the measure due to the least integer function. Fractional bases 
k correspond to strings in base [/c] with restrictions. For instance, using the golden ratio 
(j) = ~ 1.618 as a base, we get the "Fibonaccimal" |16j expansion. Here, numbers 

are represented by binary strings in which consecutive 1 digits are prohibited. As k 
approaches 1, the measure of n approaches 1/n. 

Definition 8. (Zeta classification of Turing machines). According to the zeta number, 
Turing machines can be classified into the following three classes: 

• zeta divergent Turing machines: those machines M for which Cm = oo, 

• zeta convergent Turing machines: those machines M for which Ca/ < oo, 

• tuatara machines^: those machines M for which Cm < 1- 

Proposition 9. Every self- delimiting Turing machine is a tuatara machine. More pre- 
cisely, for every self- delimiting Turing machine C , Cc is c.e. and 

l>^c>Cc> > 0. 

^We chose this name to commemorate the fact that the work was done in New Zealand. Tuatara 
( "peaks on the back" in Maori) is a reptile (not a lizard) found only in New Zealand. Tuatara is the last 
remaining member of the ancient group of reptiles Sphenodontia, the only survivor of a large group of 
reptiles that roamed the earth at the time of dinosaurs. Tuatara has not changed its form much in over 
225 million years! Its relatives died out about 60 million years ago. Tuatara has a 'third eye'; its main 
role is to soak up ultraviolet rays in the first few months of life. See more in |3Ij. 
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Proof. It is easy to see that Cc is c.e. and 

neT[dom(C)] 

rieT[dom(C)] nGT[dom(C)] 
> 2-Ll°g2(")J-l = 2-|bin(n)hl 

neT[dom(C)] neT[dom(C)] 

= 17c/2 > 0. 

□ 

We continue with the following result |2t)j : 
Theorem 10. Let U be a universal self- delimiting Turing machine. Then, 

liminf — log{#{p G dom(C/) | \p\ < n}) = 1. 

n— »oo 77, 

Proof. If M is a one-to-one (as a partial function), self-delimiting Turing machine, then 
in view of the universality of U we have: i^{q € dom(Af) [ \q\ < n — c} < i^{p G dom(C/) | 
\p\ < Ti}. To obtain the formula in the statement of the theorem we can choose M such 
that dom(M) = L, the Lukasiewicz language defined by the equation L = U 1 • (see 
[TS]^: so, for every odd n we have 



#{q G dom(M) \\q\ < n} = ^ ^( ^ j = E ^' 

odd i odd i 

where Ci is the ith Catalan number (see jlBj). 



□ 



Fact 11. T/ie domain of a universal self-delimiting Turing machine U cannot be a set 
of strings such that every element has a length that is an integer power of two. 

Proof. The result follows from Theorem^^l otherwise, liminf „^oo i log(#{p G dom(C/) I 
\p\ < n}) < 1/2. 

□ 



Corollary 12. For every universal self- delimiting Turing machine U, 1 > flu > Cc/ > 
Qu/^ > 0. 

Proof We have: 2-Liog2{«)J > 2-i°S2{«) > 2-Liog2(«)J-i^ ^here equality holds only when 
n is a power of two, so the strict inequalities hold true because of Proposition IHl and 
Fact HH □ 

Theorem 13. The zeta number of a universal self- delimiting Turing machine U is 
random. 

Proof. We define the machine C as follows: on a string w, C will try to compute U{w) = 
y, then continue by enumerating enough elements bin(ni), bin(n2), . . . , bin(nfc) G dom(f/) 
such that ^/^i > O.y and output C{w) = bin(j), where j is the minimum positive 
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integer not in the set {rii | 1 < i < k}. If the computation U{w) doesn't halt or the 
enumeration fails to satisfy the above inequality, then C{w) is undefined. 

First we note that C is a self-delimiting Turing machine as dom(C) C dom(U). 
Secondly, if C{w) is defined and U{w') = U{w) with \w'\ = Hij{U{w)), then C(w) = 
C{w'), hence 

Hc{C{w)) < \w'\ < Hu{U{w)). (1) 
Thirdly, because U is universal, H(j{x) < H c {x)+ const c, for some constc and all strings 

X. 

Finally, 

Cu<0.Cu[m+l]+2~^'\ (2) 
Given U {w) = Cu['rn + 1] we observe that 

Hu{C{w)) > m. (3) 
Indeed, if C{w) = U{hm{j)), in view of Q, we have: 

l^j = 2~'°S2(i) > 2~l-i°g2(j)J-i > 2-"^-^. 

Using in order the inequality Q, the universality of U, and we get the folowing 
inequalities: 

m < Hu{C{w)) 

< Hc{C{w)) + constc 

< Hu{U{w)) + constc 

= Hu{C.u[m + 1]) + constc, 

proving that Qu is random. □ 

It is clear that VLm can be defined for every Turing machine, much in the same way 
as Ca/ • Consequently, the zeta classification of Turing machines can be paralleled with: 

Definition 14. (Omega classification of Turing machines). According to the Chaitin 
(Omega) halting probability, Turing machines can be classified into the following three 
classes: 

• Omega divergent Turing machines: those machines M for which 0,m = oo, 

• Omega convergent Turing machines: those machines M for which < oo, 

• Omega Turing machines: those machines M for which ^Im ^ 1- 

Every self-delimiting Turing machine is an Omega Turing machine, but the converse 
implications is false. A natural question arises: do the zeta and Omega classifications 
coincide? 

Fact 15. a) For every Turing machine M , C^m < oo iff < oo, hence the classes of 
zeta divergent (convergent) Turing machines coincide, b) If < 1? then C,m < 1? but 
there exists a tuatara machine T such that Qt > !> hence the class of Omega Turing 
machines is strictly included in the class of tuatara machines. 
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Proof. The equivalence a) is obvious as well as the fact that for every Turing machine M, 
Cm < ^M- Finally, let T be the Turing machine defined as follows: T(0*1) = T(10) = 1, 
for all i > 0. It is easy to see that Qt = 1 + 1/2 >1> Ct- D 

Theorem 16. For each tuatara machine V there effectively exists a self- delimiting Tur- 
ing machine C such that Vtc = Cv- IfVis tuatara universal, then C can he taken to he 
a universal self- delimiting Turing machine. 

Proof. A real a € [0, 1] is c.e. iff there effectively exists a self-delimiting Turing machine 
C such that a = Vtc (see Theorem 7.51 in ^). The first part of the theorem now follows 
because C,y is c.e. (see Proposition EJ. 

The second part of the theorem follows from Theorem El and Theorem 1131 □ 

We can prove directly Theorem 1161 To this aim we need the Kraft-Chaitin Lemma, 
see [3: 

Lemma 17. Given a computable enumeration of positive integers Ui such that 
X^i < 1, we can effectively construct a prefix-free set of binary strings {xj} such 
that \xi\ = Ui. 

We can now present a direct proof of Theorem llGI Given a computable enumeration 
of positive integers rrij, we can write l/m-j as a possibly infinite sum of reciprocals of 
powers of 2. We can then lay these out on a grid and enumerate the non-zero elements 
along each diagonal. For example, given the enumeration {1,2,3,4,5,6,...} the grid 
would be as follows: 



1/2 


= 1/2 


+ 





+ 





+ 
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1/3 


= 1/4 
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1/16 
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1/64 
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1/256 
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1/4 


= 1/4 


+ 





+ 





+ 
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1/5 


= 1/8 
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1/16 
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1/128 


+ 


1/256 


+ 


1/6 


= 1/8 
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1/32 


+ 


1/128 


+ 


1/512 


+ 



The diagonal enumeration, taking diagonals from lower left to upper right, would 
be {1/2,1/4,1/4,1/16,1/8,1/64,1/8,1/16,1/256,...}. Since this enumeration is also 
computable, we can apply Lemma [T7I to get a c.e. prefix-free set S. 

Let {rui} be an enumeration of dom(Ty) and derive S as above. Define dom(y)=S, 
hence C,w = ^v- 

□ 

We have seen that every self-delimiting Turing machine is a tuatara machine (Proposi- 
tion IHl), but the converse is not true (Fact El b)). Another example follows. 

Example 18. Given a self- delimiting Turing machine C we construct a new machine 
Tie {which we call a product machine), such that 

dom(nc) = {piP2 ■■■Pn I bin"^(pi) < bin~^(p2) < • • • < bin~^(p„), 

Pi G dom(C), 1 < i < n}, 

and 

Ilc{PlP2 ■■■Pn) = C{pi)C{p2) ■ ■ ■ C{pn). 
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Clearly, He is not self- delimiting, but 



pedom(C) 



Comment. The zeta number can be easily extended to Turing machines working on 
an arbitrary finite alphabet: we simply replace the computable bijection bin with the 
quasi-lexicographical enumeration of strings over the given alphabet (see more in |2]). 
Because the strings in the domain of the Turing machine do not use any of the new 
symbols, the new bijection maps them to a much smaller subset of the natural numbers, 
and every binary Turing machine becomes convergent/tuatara when thought of in the 
class of, say, ternary /quaternary machines. 

Next we answer in the affirmative the following question: is every Omega Number 
also a zeta number? To answer, we need two simple lemmata. 

Lemma 19. If M,M' > 2 are integers, and q > is a rational such that 1/M < q < 
1/(M - 1) and 1/M' <q- 1/M < 1/(M' - 1), then M < M' . 



Lemma 20. Fix an integer N > 2. Then, every rational can be effectively written as a 
finite sum of distinct unit fractions whose denominators are all greater than or equal to 
N. 



Proof. Let Hij = 7 + ~'~ ' ' ' ~'~ J' i — j- Fix the rational q. As for every z > 1, 
limj^oo Hi^j = 00, given N > 2 we can effectively find an integer k > (depending on 
A^) such that 

HN,N+k < q < H^^Nj^k+l- 
Put q' = q — Hfyf^iq^k and note that 

< < — -■ (4) 

N + k + l ^ ' 

We apply now the greedy algorithm for representing q' as an Egyptian fraction (i.e. as 
sum of distinct unit fractions, see ^H]) Sind we show that the denominators of all unit 
fractions will be larger or equal to A^. First we get an integer M' > 2 such that 

— < o' < — > (5) 

and we note that in view of Q and Q we have M' > A + /c + 1. We continue with the 
greedy algorithm 

— <q'-—< , (6) 

and we apply Lemma El to @ and © to deduce that M" > M'. The algorithm 
eventually stops because the greedy algorithm always stops over the rationals as the 
numerator decreases at each step (it must eventually reach 1, at which point what remains 
is a unit fraction, and the algorithm terminates). □ 



Theorem 21. For each self- delimiting Turing machine C there effectively exists a tu- 
atara machine V such that Cv = ^c- 
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Proof. We start with the expansion of 0,c = X^i>i2~'^'', where xi,X2,--- is a c.e. 
enumeration of dom(C) and we use Lemma 120] to produce a c.e. enumeration of non- 
negative distinct integers ni,n2, ■ ■ ■ from the representations as sum of distinct unit 
fractions of the terms 2~l^il, 2~^^^^, . . ., and finahy we define y(bin(nj)) = bin(nj). □ 

Actually, we can describe a more precise simulation of a self-delimiting Turing ma- 
chine with a tuatara machine. Let HW{p) be the Hamming weight of the string p, i.e. 
the number of 1 bits in p. 



Theorem 22. Given a self- delimiting Turing machine C we can effectively construct a 
tuatara machine V such that = ^C- Furthermore, dom(y) D dom(C), and to each 
string p € dom(C) we have HW{p) + 1 strings in dom(y), p among them. 

Proof. We define the domain of the tuatara machine V to be 

dom(y) = IJ X{p), 
pedom{C) 

where X{p) is the set {p} U {pO^\pi = 1} and pi is the ith bit of p, numbering from the 
left and starting with i = 1. We note that for each p G dom{V) with pi = 1 we have 
bin~^(pO*) = 2* • bin"^(p), so for every p € dom(y) we have: 

1 ^ 1 ^ Pi ^ hin-^jp) ^ 

x<^X{p) ^ ' ' 1=1 

Consequently, the contribution of 2^1^' to ily is matched by the sum of distinct unit 
fractions Ylx(^x(p) bin~^ (x) ' ^^^^ P ^ dom(C), so Cv = ^c^- Furthermore, X[p) has 
HW{p) elements, and for distinct strings p,q & dom(y), the sets X{p) and X{q) are 
disjoint, hence the unit fractions derived are mutually distinct. □ 

Scholium 23. Given a universal self- delimiting Turing machine U we can effectively 
construct a tuatara machine W universal for all self- delimiting Turing machines such 
that CvK = ^u- 

Proof. In case ?7 = C is a universal self-delimiting Turing machine, the construction 
in the proof of Scholium [22 gives a tuatara machine W which is universal (but not 
self-delimiting) for the class of self-delimiting Turing machines. □ 

Next we turn our attention to universal convergent /tuatara machines. 

Theorem 24. The sets of convergent machines and tuatara machines are c.e. 

Proof. If M > 1 is an integer and C[M] = {T | T is a Turing machine with (^t < M}, 
then the set of convergent machines is L)m>iC[M] and C[l] is the set of tuatara machines. 
Standard proofs (see |2]) show that both sets are c.e. □ 

Theorem 25. Let (Ci)i>i be an enumeration of tuatara machines. We define W{0^1x) = 
Ci{x), for all X G S*. Then, W is a universal tuatara machine. 

*For example, X(lOll) = {1011,10110,1011000,10110000}; ^^^^^ = 1/27, and 1/27 + 1/54 + 

1/216 + 1/432 = 1/16. 
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Proof. First note that Onbin(n) = bin(2*+i+Li°S2(")J +n),n > 1. Now W acts as follows: 

W^(bm(2^+^+Li°S2(")J + n)) = Ci(bm(n)). (7) 

The machine W is universal because it can simulate any other tuatara machine with 
a constant prefix, and it is tuatara because: 



fceT[dom(Vy)] 

= E E 



2t+i+Liog2(".)J _|_ n 

i>l n6T[dom(C,)] 
i>l n6T[dom(C,)] 

£E E 



(2* + l)2'°S2(n) 
>1 n6T[dom(C0] ^ ^ 



^ 2* + 1 ^ 2'°S2i 

i>l n6T[dom(C,)] 

<E— ■ E - 

i>0 neT[dom(C,)] 

< y ■ cc- < 1. 

- 2 * + 1 ' ~ 



□ 



Comment. The same argument as in Theorem I^Hl shows that each C[M] = {T \ 
T is a Turing machine with ^ M} has a universal machine. 

Theorem 26. There exists a universal convergent machine; furthermore, this machine 
can be chosen to be tuatara. 

Proof If {Cj^)i>i is an enumeration of C[M], then we define W{0-^^''^hx) = C^\x), 
for ah x G S*; here J(i, M) = 2*(2M + 1) - 1. In view of and 



fc6T[dom(VK)] 



E E 



2J(i,M)+l+Llog2(n)J I ^ 
j>l,M>l neT[dom(C^Af)] 

- ^ ^ (2"^(«.A^) + l)2l°S2(") 

i>l,M>l„eT[dom(Cf^)] ^ ^ 
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i>l,Af>l 

M 

— 2-^ 22'(2M+1)-1 _|_ 1 
i>l,M>l 

\^ 1 M 

i>l,M>l + 

it follows that W is tuatara and universal for the class of convergent machines. □ 



3 Natural complexity 

Many properties can be elegantly expressed in terms of complexity. For example, U is 
a universal self-delimiting Turing machine iff for every self-delimiting Turing machine 
C there exists a fixed constant c, depending on U and C, such that for every string 
X E S*, Hu[x) < Hc{x) + c. In this spirit we present a complexity-theoretic proof of 
the randomness of the zeta number of a universal tuatara machine. We need first the 
following definition: 

Definition 27. (Hj The natural complexity of the string x G E* (with respect to the 
tuatara machine V) is Vvix) = min{n > 1 j y(bin(n)) = x}. 

Fact 28. ^ a) A tuatara machine W is universal iff for every tuatara machine V there 
exists a constant e (depending upon W and V) such that < e • Vy, for all strings 

X e E*. 

b) A real a G (0, 1) is random iff there exist a universal tuatara machine W and an 
e > such that for all n > 1, 2^" • VvK(aM) > £• 

Comment. The natural complexity of a string x is the position in the enumeration 
given by bin of the 'elegant' program for x, denoted x* = bin(Vvi/(a^))- The following 
facts follow from the definition: 

• for each string x, M/^(bin(VH^(x))) = x, 

• for every j > 1, if W(hm(j)) = x, then Vw{x) < 

• for each string x, x* is the minimal (according to the quasi-lexicographical order) 
input for W producing x. 

Example 29. For the tuatara machine constructed in the proof of Theorem \2FA we have: 
Vh/(x) <2*+i-Vc,(x). 

Theorem 30. The zeta number C,w of a universal convergent (tuatara) machine W is 
random. 
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Proof. The proof follows the same steps as the proof of Theorem 1131 We define the 
tuatara machine D acting as follows: on a string w, D will try to compute W{x) = y, 
then continue by enumerating enough elements bin(ni), bin(n2), . . . ,bin(nfc) € dom(VF) 
such that Yli=i ^/iT-i > 0-y and output C{w) = bin(j), where j is the minimum positive 
integer not in the set {rii \ 1 < i < k}. If the computation W{x) doesn't halt or the 
enumeration fails to satisfy the above inequality, then D{x) is undefined. 

If D{x) is defined, then W{x) is also defined, so D is tuatara. More, W{x) = W{x*), 
where x* = hm{Vw{x)). It follows that D{x) = D{x*), hence 

Vd{D{x)) < hm~\x*) = Vw{W{x)). (8) 

By universality of W we get a constant en > such that for all strings x, 

VTy(x) < en ■ Vd{x). (9) 

Next we show that if W{x) = Cwb^T], then 

Vw{D{x)) > 2"^. (10) 

Indeed, from VwiD{x)) < 2^" it follows that if W{hm{j)) = x, then 1/j contributes 
towards so it has to be no larger than 2"*. 

Using in order the inequalities ([T?H) . Q, and ^ we get the folowing inequalities: 

2™ < Vw{D{x)) 

< ED ■ VniDix)) 

< ED ■ yw{W{x)) 
= £d ■ Vh/(CH)) 

proving that (^jj is random. □ 

Chaitin considered LISP program-size complexity ^U] and found that the number of 
characters required in a program to produce the first n bits of LISP's halting probability 
was asymptotic to n/log2 (number of characters). This is the first use we know of where 
an author has considered the asymptotic randomness of a string and the idea that the 
lower bound on the complexity of prefixes of a binary sequence might be proportional to 
a constant less than one times the length of the prefix. In this case, the constant comes 
from considering characters rather than bits. 

Staiger [^121], Tadaki jHUI, and Calude, Terwijn and Staiger |1] have studied the 
degree of randomness of sequences or reals by measuring their "degree of compression" . 
Tadaki [20] studied the partial randomness of a generalisation of Chaitin's halting prob- 
ability. The lower bound on the complexity of successive prefixes of a random sequence 
is a line with slope 1. The lower bound for the prefixes of a partially random sequence 
is a line with slope < 1. 

More precisely, following PU] (see also 0), for every s > and universal self- 
delimiting Turing machine U we define the real:§ 

nuis) = 2-^'"' 

p e dom(L'') 

If < s < 1, then Qc/(s) = oo. 
^Tadaki's original notation was nB, where D = l/s. 
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Theorem 31. 30^ For every computable s > 1, the number Vtu{s) is Chaitin 
1/ s— random, that is, there exists a constant c > such that for all m >1 we have: 

Hu{i^u{s)[m]) > m/ s — c. 

An earlier result in algorithmic information theory states that there is no infinite 
sequence whose prefixes have all maximal Kt complexity (see more in ^). To state this 
result more precisely we fix a universal Turing machine T and denote by Kt the induced 
plain complexity. 

Theorem 32. (0 UH]) For every c > the set {a E (0,1) | KTia[m]) > m - 
c, for all m > 1} is empty. 

Theorem has given rise to alternate definitions of random sequences with respect 
to the plain complexity ^11 and a characterisation of random reals: the real a G (0, 1) 
is random iff KT{oi[m]) > m — iCT(bin(m)) — c, for all m > 1, UH]- We are not going 
to pursue this line here, but instead we will study the validity of Theorem 1321 for partial 
randomness. 

Given a computable s > 1, we will investigate reals a* S (Oil) for which there is 
constant c > such that for every m > 1: 

KT{a'[m])>m/s-c. (11) 

A real a* satisfying the inequality ()11() will be called "1/s — i^-random". 

Random reals satisfy (|llj) . We will investigate some other examples of "1/s — K- 
random" reals. 

Example 33. Let T be a universal Turing machine and define M{xx) = T{x), for every 
string x. The zeta number of M is 1/2 — K -random. 

One particularly simple self-delimiting Turing machine is Barker's language Iota pp. 
The simplest way to define Iota is in terms of Church's A— calculus: the universal basis 
{S = Xxyz.xz{yz), K = Xxy.x} suffices to produce every lambda term, but for universal- 
ity it is not necessary to have two combinators. There are one-combinator bases, known 
as universal combinators. Iota is a very simple universal combinator, Xf.fSK, denoted 

0. To make Iota unambiguous, there is a prefix operator, 1, for application. 

The construction is essentially a very stripped-down version of LISP with only one 
atom, 0; since the atom takes a single input, we can represent the open parenthesis with 

1, and we note that closing parentheses are unnecessary. 

Example 34. The zeta number of Iota is at least Chaitin 1/193— random. 

Proof. The traditional representation of F and T in combinatorial logic is = -F and 
KI = T. In Iota, these are represented by the strings 1010100 and 10100, respectively. 
We can encode bit strings as lists {head, tail), where the pairing operator (— , — ) is the 
lambda-calculus term P = Xxyz.zxy. In Iota, this operator is encoded by the 184-bit 
string 
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P=1110101010011101010100110101001010101001110101010011010100101 
0100111010101001101010010101010011101010100110101001101010100 
1001110101010011010100101010010011101010100110101001010100100 

It has the property that IFllPxy = x, while ITllPxy = y, so we can extract the 
head and the tail of the list. We can distinguish a list from a Boolean value, so by 
terminating the list with F, we can know when we have read the whole string. Each bit 
in the list requires two applications (one to apply P to the head, and another to apply 
the result to the tail), the pairing operator itself, and a Boolean value. The longest 
this can possibly be is 2+184+7 = 193 bits. We can write a program that will read a 
bitstring x = F^Tp, where p is any string of bits, and return Ci{p), where Q is the ith 
self-delimiting Turing machine in an enumeration of the set. The zeta number will be at 
least Chaitin 1/193— random, because it takes no more than 193n + c bits to ouptut n 
bits of for any universal self-delimiting Turing machine U. Therefore the zeta number 
of Iota itself is at least Chaitin 1/193— random. □ 

Comment. A sharper result will be presented in Example 1441 There are much better 
encodings available in Iota than the naive one above. We conjecture that, in fact, lota's 
zeta number is "more random" (see our list of open questions at the end of this paper). 

We continue with a more general construction. Tadaki's generalization of Chaitin's 
halting probability (see ^20,) is a zeta function. Zeta functions appear as partition func- 
tions and in expectation values in statistical systems, and the parameter s corresponds 
to an inverse temperature. The partition function for a statistical system X has the form 

where H is the energy (Hamiltonian) of the state x, and s is inversely proportional to 
the temperature of the system.^ An observable is a function k : X ^ H. The average 
value of the observable for a system at equilibrium is 

The partition function acts like a normalization constant. 

Taking X to be the set of programs, we let the "energy" of a program be its length. 
The partition function becomes 

Z(s) = 5^e-H. 

We can recover the base 2 if we let s = s' In 2: 

Z(s'ln2) = ^2-^'IPl. 

Taking X to be prefix-free guarantees that the partition function converges at s' = 1 by 
the Kraft-Chaitin Lemma; however, the function converges for any subset of S* when 
s' > 1. When X = E*, the set of aU binary strings, Z(s'ln2) = 1/(1 - 2-"'+i). 

^The notation H — used only in this motivational part — does not denote the program-size complexity, 
although it is not too far away from it. 
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We now define our observable to be the halting function of the Turing machine T: 
'^t(p) = 1 if T halts on p, otherwise. The probability that a program will halt is then 

^'^^^'^ = — W) — = 

All of this passes over nicely to the zeta number. We let X = N and let the "energy" 
of n G N be In n. The partition function becomes 

the Riemann zeta function. 

We define the "zeta function of T" to be 

Ct(s) = Yl '«T(bin(n)) ■ n'' = ^ n'', 
neN neT[dom(r)] 

and the probability that a program will halt on T is 

(Tis) 



as) 



Given a Turing machine M (which may or may not be self-delimiting) , we define "the 
halting probability of M at s" to be 



{km){s) = 




Fact 35. For real s > I and universal T, < {kt){s) < 1. 

Proof. Since T is a universal Turing machine, then there must be some integer q such 
that bin(q') ^ dom(r). Therefore the numerator, which sums only over those q such that 
bin(g) G dom(r), is smaller than the denominator, which sums over all positive natural 
q. Since there must be at least one program that halts, the numerator is positive. 

□ 



Theorem 36. For every computable real s > 1 and universal T, («;t)(s) is 1/s — 
K— random. 

Proof. Given the first m + [log2(l — 2~''+-'^)J bits of (/tT)(s), we can compute the halting 
status of all programs p G dom(r) such that \p\ < m/s. Then, there is a computable 
function ^ that, given {KT){s)[m+ [log2(l — 2~*+^)J], produces a string not in the output 
of those programs, hence 

KT{{KT){s)[m]) > m/s - (c* + Llog2(l - 2-^+^)]). 

□ 
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Comment, a) The number {kt){s) is a halting probabihty (see 0)- One particularly 
nice value is s = 2 where '£,^^0 2-2Li°g2{")J = 2. With reference to Example IHHl iiT = U 
is self-delimiting, then ^Im = ^^m(1) is Chaitin 1/2— random: 

nM{l)= Yl 2"'"'= E 2-2N=Oc;(2) = 2(kc;)(2). 

a;edom(M) xedom((7) 

b) Theorem 1361 shows a property true for partial random reals, but not for random 
reals, cf. An opposite phenomenon was described in 4 . The following character- 
isation of random reals is no longer true for partial random reals: A real a £ (0, 1) is 
random iff there exist a constant c > and an infinite computable set M C N such that 
Hu{a[n]) > n — c, for each n G M . 

Obviously, if a is l/s — /C-random, then it is also Chaitin 1/s— random. 

Corollary 37. If U is a universal self- delimiting Turing machine, then for every com- 
putable real s > 1, {njj)(s) is Chaitin 1/ s— random. 

Note that in this case, {kij){s) is just a computable factor times Vtu{s). 
Furthermore, the converse implication is false: 

Proposition 38. There exists a Chaitin 1/2— random real which is not 1 / 2 — K -random. 

Proof. Let K = Kt, where T is a universal Turing machine, and let a = O.X1X2 ■ ■ ■ Xn - ■ ■ 
be Chaitin 1— random. On one hand, the real a is not 1 — i('-random, cf. j2|. On 
the other hand, the number /? = 0.0x10x2 • ■ ■ Ox„ • • • is Chaitin 1/2— random; if /3 were 
1/2 — ii'-random, then a would be 1 — X-random, a contradiction. Indeed, for all 
n > 1, Kt{0xi0x2 ■ • • Oxn) < KFoTi0xi0x2 • ■ ■ Oxn) + c' < Kt{xiX2 ' • • x„) + c', where 
F o T{y) = 0xi0x2 • • • Ox„ whenever T{y) = X1X2 • • • Xn- 

□ 

Lemma 39. Let a S (0, 1). // there exist two integers c,N>0 and a real a € (0, 1] such 
that for all m > N we have KT{ct[m]) > a ■ m — c, then we can find a constant b > 
such that KT{a[m]) > a ■ m — b, for all m > 1. 

Proof. Put b = maxi<j<jv max{0, a ■ i — KT{a[i])} + c. 

□ 

We now define a new form of partial randomness by requiring that the real is as close 
as we wish to being (partially) random, without necessarily being random. Following 
ES] we define the lower asymptotic complexity 

k{a) = liminf —K{ai . . . an). 

n— >oo n 

Following [22] we have: 

Theorem 40. Let s > 1 be computable. Then, for a real a, the following statements are 
equivalent: 

1) We have: k{a) > 1/s. 
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2) For every computable real t > s > 1, a is 1/t — K -random. 

3) For every computable real t > s > 1, a is Chaitin 1/t— random. 

Proof. Conditions 2) and 3) are equivalent because of the asymptotics. The equivalence 
with 1) can be verified by elementary calculus. 

□ 

Definition 41. Let s > 1 be computable. We say that a real number a € (0, 1) is 
asymptotically 1/s-random if one of the equivalent conditions in Theorem^UJis satisfied. 
If s = 1, then a is called asymptotically random. 

The notion of asymptotic 1/s-randomness induces a strict hierarchy on s > 1. We 
need the following result (for the definition of the Hausdorff dimension see Falconer ) '■ 

Theorem 42. |21j Let dim// be the Hausdorff dimension and let s > 1 be computable. 
Then: 

dim//({a G [0, 1] | k{a) < 1/s}) = dim//({a S [0, 1] | k{a) = l/s}) = 1/s. 

In view of Theorem 021 we will refer only to asymptotic 1 / s-randomness (without 
mentioning K or H). Consequently, using Theorems 1401 and 1421 we get: 

Corollary 43. The notion of asymptotic 1/s-randomness real induces a strict hierarchy 
for s > 1 . 

Example 44. The zeta number of Iota is at least 1 / 194 — K -random and at least asymp- 
totically 1/193-random. 

Proof. Since we know where the encoded bit string ends, Iota can simulate an arbitrary 
universal Turing machine, not just a self-delimiting one. For any s > 1 we can print 
m bits of Cuis) with at most 193m + c bits. So the zeta number of Iota is at least 
1/194 — if-random and at least asymptotically 1/193-random. 

□ 

Given an arbitrary Turing machine M, we define "the natural halting probability at 
s" to be 




= Cm{s)/C{s), 



where we have added a superscript to n to distinguish it from the Tadaki-Chaitin case. 
Next, we can define the set 

P = {pi\ bin(i) e dom(M)}, 

where pi is the ith prime in increasing order, and the set 

S = {n \ all prime factors of n are in P}. 

The set bin(S') is the domain of a Turing machine R{M) {prime product machine) 
that performs the following steps on an input x G T,*: 
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1. Compute n = bin~^(x). 

2. Compute the prime factors pi of n. 

3. For each pi, simulate M(bin(i)). 

4. Output the empty string. 

Then, 

Ci?(M)(s) = 2;n-=ni/(l-P~^)- 

neS p&P 

The definition of the Omega number works nicely for string concatenation (see the 
product machine, Example I18|l : the zeta number for this machine is complicated. In 
contrast, the zeta number works well for integer multiplication as in the case of the 
prime product machine; the Omega number of this machine is complicated. 

Theorem 45. For every universal Turing machine T and computable s > 1, 
is asymptotically 1/s-random. 

Proof. The Prime Number Theorem implies that for i > 5, ilog(i) < pi. Fix a com- 
putable real s > 1. Given [msj + 1 bits of (K^^y^)(s), we can compute the halting status 
of all programs bin(i) such that pi < 2"^. Consequently, 

ilog(i)<2-, 

i < 2™/iy(2'"), 
|bin(i)| = Llog2(i)J <m- log2(W^(2™)) = W(2™)/ln(2). 

Here, W is the Lambert VF-function, the inverse function of f{x) = xe^, it has 
the series expansion W{x) = ^^^1 ' x". Therefore, given \ms\ + 1 bits, we can 

compute the halting status of all programs whose lengths are each less than W{2'^) / ln(2). 
Since 

lim = 1, (12) 

m^oo m ln(2) 

the result follows. Indeed, in view of H12|) . for each i > 5 and e > there exists a bound Nf, 
such that > (1 — e)m, for every m > N^, hence in view of Lemma ISHl 

we can find a constant > such that for all m > 1, KT{{K'^^rp^){s)[m]) > m/s — Cg. 

□ 

Corollary 46. If U is a universal self- delimiting machine and s > 1 is computable, then 
is asymptotically 1/ s— random. 

Lemma 47. Let a G (0,1). If there exist three integers c,a,N > such that for all 
m > N we have KT{oi[m + c[log2 mW) > m — a, then for every computable s > 1 we can 
find a constant 6 > such that KT{ct[m]) > m/s — b, for all m > 1. 

Proof. For each computable s > 1 we can find a constant d > such that for all m > 1, 
KT{a[m + c[log2?TiJ]) > ^{m + c[log2?nJ) — d, so the required inequality follows from 
Lemma 1391 

□ 
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Theorem 48. IfU is a universal self-delimiting Turing machine, then Qjj is asymptot- 
ically K -random. 

Proof. Since Qjj is random, there exists a constant c > such that for all m > 1 
Hu(Qu[m]) > m — c. On the other hand, there exists a > such that for all m > 1 we 
have Kxi^uiiT^ + c^L-'oS2 "^JD — Hij{^}ij[m]) > m — c, hence in view of Lemma Wl\ for 
every computable s > 1 there exists an integer 5 > such that for all m > 1 we have: 
i^r(^c/[w-]) > ^/s — b. This shows that is asymptotically random. 

□ 

Corollary 49. If U is a universal self- delimiting machine, then Qu is asymptotically 
random. 

Proof. Use Theorem 1481 and Scholium 1231 □ 
The converse implication fails to be true: 

Theorem 50. There is a self- delimiting Turing machine V such that Qy is asymptotically 
random, but not random. 

Proof. Let p be a self-delimiting version of the string p such that \p\ ~ |p| + 2 log2 \p\ (see 
for example [2]). Let (Cj) be a c.e. enumeration of all self-delimiting Turing machines 
and define V{G^Vp) = Ci{p). Clearly, there is a constant c > such that for all m > 1, 
Kt{CvV^ + 2[log2 mW) > rra — c, so in view of Lemma 1171 Qy is asymptotically random. 
However, V is not universal, so C,y is not random. 

□ 

Comment. A different proof for Theorem EOl can be obtained using a non-sparse dilu- 
tion, cf. Example 3.18 in [231 or Theorem 4.3 in |17j . 

Corollary 51. There is a self- delimiting Turing machine V such that C,y is asymptoti- 
cally random, but not random. 

Comment. If xiX2 ■ ■ ■ is a random sequence, then the sequence 
is not random, but asymptotically random. 

Lemma 52. For every pair of computable reals r,t > 1 and integer c > 1 there exists a 
computable real s > 1 such that for every m > 1 we have: — ■ m > j ■ log2 rn. 

Proof Take 1 = 1 + 1- 

□ 

Theorem 1321 proves that there is no infinite sequence whose prefixes have all maximal 
Kt complexity. A similar result can be proved for program-size complexity Hjj. However, 
this result will be false for asymptotic randomness. 

Theorem 53. There exists a real a € (0, 1) such that for every pair of computable reals 
r,t > 1 and integer c > 1, there exists an integer b > 1 such that for every m > 1, 

1 c 
Hu(a[m]) > — ■ m -\ — • logo m — b. 
r t 

So, Hu{a[m]) is as close as we want, but never equal, to max|^|=„ //(/(x) — 0(1). 
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Proof. Take an asymptotically random real a, consequently, for every computable s > 1 
there is a constant a > such that Hu{a['m]) > ^ ■ m — a, for all m > 1, and then use 
Lemma 1521 

□ 

4 Open problems 

Many interesting questions remain unsolved. For example, can the machine V in 
Scholium 1231 be taken to be universal self-delimiting or universal tuatara? 

The zeta number of Iota is at least 1/194 — X-random and at least asymptotically 
1/193-random (Example I44|) : we conjecture that natural halting probability of Iota is 
asymptotically X-random, but not random. 

Let is a universal self-delimiting machine with an oracle to the Halting Problem, 
and = Oj/k; Q^{2) is Chaitin 1/2 — 2— random. Is 0^(2) random or asymptotically 
if-random? 
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